DiscreteMarkovProcess

DiscreteMarkovProcess[i0,m] represents a discrete-time, finite-state Markov process with transition matrix m and initial state i0.

DiscreteMarkovProcess[p0,m] represents a Markov process with initial state probability vector p0.

DiscreteMarkovProcess[…,g] represents a Markov process with transition matrix from the graph g.

Please visit the official Wolfram Language Reference for more details and examples on core symbols.